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EXECUTIVE  OVERVIEW 

Financial  enterprises  rely  heavily  on  paper-based  documents  to  conduct 
various  operations;  this  is  true  both  for  external  operations  involving  customers 
and  other  financial  institutions,  as  well  as  internal  operations  involving  various 
departments. 

Researchers  at  MIT  have  looked  at  the  possibility  of  taking  information 
directly  from  paper  documents,  especially  handwritten  documents,  to  computer- 
accessible  media.   Automated  reading  involves  several  steps  as  follows: 

(i)  Scanning  of  document; 

(ii)  Location  of  area  to  be  "read"; 

(iii)  Decomposing  the  selected  area  into  separate  characters; 

(iv)  Adjusting  size  and  slant  of  each  character; 

(v)  Recognizing  each  character;  and 

(vi)  Testing  whether  input  has  been  correctly  read. 

Based  on  several  years  of  sustained  research,  the  researchers  have  attained 
very  high  "reading"  speed  and  accuracy,  even  in  situations  where  the  quality  of  the 
input  material  is  poor.  Patent  rights  for  some  of  the  new  techniques  have  been 
applied  for.  Sponsor  companies  are  eligible  to  test  the  new  techniques  in  their 
respective  environments  at  no  charge. 

The  work  performed  so  far  is  described  in  a  number  of  published  paper  and 
working  papers.  The  list  of  working  papers  is  as  follows: 

IFSRC  #  107-89     Optical  Image  Scanners  and  Character  Amar  Gupta 

Recognition  Devices:  A  Survey  and  New  Sanjay  Hazarika 

Taxonomy  Maher  Kallel 

Pankaj  Srivastava 

IFSRC  #  123-90R  An  Improved  Structural  Technique  for  Patrick  S.  P.  Wang 

Automated  Recognition  of  Handprinted  Symbols  Amar  Gupta 

Revised  October  1990 

IFSRC  #  124-90     Integration  of  Traditional  Imaging,  Expert  Evelyn  Roman 

Systems,  and  Neural  Network  Techniques  for  Amar  Gupta 

Enhanced  Recognition  of  Handwritten  John  Riordan 
Information 

IFSRC  #  151-91     Handwritten  Numeral  Recognition  Using  Ronjon  Nag 

Dynamic  Programming  Neural  Networks  on  an  Alexis  Lui 

Off-Line  Basis  Amar  Gupta 

IFSRC  #  162-91R  Algorithms  for  Thinning  and  Rethickening  M.  Nagendraprasad 

PROFIT  93-03       Binary  Digital  Patterns  Patricks.  Wang 

Amar  Gupta 

IFSRC  #  173-91     A  New  Algorithm  for  Slant  Correction  of  Vanessa  C.  Feliberti 


Handwritten  Characters 

IFSRC  #  21 4-92     An  Algorithm  for  Segmenting  Handwritten 
Numeral  Strings 

IFSRC  #  21 5-92     A  New  Algorithm  for  Correcting  Slant  in 
Handwritten  Numerals 

TFSRC  #  21 8-92     A  System  for  Automatic  Recognition  of  Totally 
Unconstrained  Handwritten  Numerals 

IFSRC  #  219-92     A  CoUection  of  Papers  on  Handwritten  Numeral 
Recognition 

IFSRC  #  261-93     An  Adaptive  Modular  Neural  Network  with 
Application  to  Unconstramed  Character 
Recognition 

IFSRC  #  287-94     An  Integrated  Architecture  for  Recognition  of 
PROFIT  93%4       TotaUy  Unconstrained  Handwritten  Numerals 


IFSRC  #  288-94     Detection  of  Courtesy  Amount  Block  on  Bank 
PROFIT  93-09       Checks 


IFSRC  #  289-94     A  Knowledge  Based  Segmentation  Algorithm  For 
PROFIT  94  14       Enhanced  R^ognition  of  Handwritten  Courtesy 
Amounts 


Amar  Gupta 

Peter  L.  Sparks 

M.  V.  Nagendraprasad 

Amar  Gupta 

M.  V.  Nagendraprasad 
Amar  Gupta 
Vanessa  Feliberti 

M.  V.  Nagendraprasad 


Amar  Gupta 


LikMui 
Arun  Agarwal 
P.  S.  P.  Wang 

Amar  Gupta 

M.  V.  Nagendraprasad 

A.  Liu 

Amar  Gupta 

S.  Ayyadurai 

Arun  Agarwal 
Len  M.  Granowetter 
Amar  Gupta 
P.  S.  P.  Wang 

Karim  Hussein 
Amar  Gupta 
Arun  Agarwal 
Patrick  Shen-Pei  Wang 


the  papers,  and  the  software  developed  at  MIT. 

The  Principal  Investigator  for  the  imaging  area  is  Dr.  An>f  Gupta  Co- 
Directo'^-PROF,^-  IniHaavl  MIT  ^'-^^^3^ ^-^^-^-^.^^^'^^^^^^^ 
^^^^;  fSf -a^uTSt-r  S'c^e^^d  suggestions  are 
encouraged. 


DIGITAL  SIGNAL  PROCESSING  3,  97-102  11993) 


Algorithms  for  Thinning  and  Rethickening 
Binary  Digital  Patterns 

M.  V.  Nagendraprasad,  Patrick  S.  P.  Wang,*  and  Amar  Gupta^ 
Massachusetts  Institute  of  Technology,  Cambridge,  Massachusetts  02139 


1.  INTRODUCTION 

Pattern  recognition  and  image  processing  applica- 
tions frequently  deal  with  raw  inputs  that  contain 
lines  of  different  thickness.  In  some  cases,  this  varia- 
tion in  the  thickness  is  an  asset,  enabling  quicker  rec- 
ognition of  the  features  in  the  input  image.  For  exam- 
ple, in  processing  aerial  photographs,  detection  of 
major  landmarks  can  be  aided  by  the  variations  in  the 
thickness  of  the  contours.  In  other  cases,  the  varia- 
tion can  be  a  liability,  and  can  cause  degradation  in 
the  accuracy  and  the  speed  of  recognition.  For  exam- 
ple, in  the  case  of  handwritten  characters,  the  degree 
of  uniformity  of  the  thickness  of  individual  strokes 
directly  impacts  the  probability  of  successful  recogni- 
tion, especially  if  neural  network  based  recognition 
techniques  are  employed. 

For  the  latter  category  of  applications,  uniform 
thickness  can  be  attained,  prior  to  recognition  stage, 
by  first  thinning  the  input  pattern  to  a  thickness  of  a 
single  pixel  and  then  rethickening  it  to  a  constant 
thickness.  The  basic  structure  and  the  connectivity  of 
the  original  pattern  can  be  preserved  irrespective  of 
the  underlying  complexity,  through  the  stages  of 
thinning  and  rethickening. 

Digitized  bitmap  patterns  consist  of  an  array  of 
pixels,  where  each  pixel  is  either  1  ("on"  pixel)  or  0 
("ofT'  pixel).  In  thinning,  also  called  skeletonization, 
the  redundant  "on"  pixels  are  eliminated  from  the 
original  pattern  to  yield  its  equivalent  skeletonized 
pattern.  During  the  subsequent  stage  of  rethickening, 
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"on"  pixels  are  systematically  added  to  reconstruct 
an  equivalent  of  the  original  pattern.  Because  the 
thinning  process  is  usually  considered  more  difficult 
than  the  rethickening  process,  the  bulk  of  this  paper 
deals  with  thinning  aspect. 

Section  2  deals  with  basic  notation.  The  thinning 
stage  is  discussed  in  Section  3.  Section  4  presents  a 
theoretical  proof  related  to  a  new  and  faster  thinning 
algorithm.  The  rethickening  stage  is  discussed  in  Sec- 
tion 5.  Results  are  presented  in  Section  6  and  conclu- 
sions in  Section  7. 

2.  BASIC  NOTATION 

One  of  the  authors  [11]  has  previously  presented 
definitions  and  notation  related  to  the  thinning  algo- 
rithms presented  here.  In  order  to  facilitate  a  direct 
comparison  of  the  new  algorithm  with  a  previous  one 
proposed  in  [11],  the  same  notation  is  utilized  in  this 
paper. 

Definition  1.  The  neighbors  of  a  pixel, p:[i,)],  are 
identified  by  the  eight  directions,  [i  -  l,j],  [i  —  l,j  + 

1],  [',;"  +  1],  [i  +  hj  +  1],  [i  +  IJ],  [i  +  IJ  -  1],  [ij  - 
1],  [i  -  I,  j  -  1).  The  directions  are  also  assigned  a 
number  k  taking  values  from  0,  . .  . ,  7  as  shown  in 
Fig.  1. 

Definition  2.  The  contour  points  of  a  digital  pat- 
tern are  defined  as  those  pixels  for  which  at  least  one 
neighbor  is  off.  In  Fig.  2,  "a,"  "b,"  .  .  .  ,  "k"  and  some 
of  the  pixels  'm'  and  'n'  are  contour  points  while  none 
of  the  "1"  s  is  a  contour  point. 

Definition  3.  The  contour  loop  is  a  set  of  contour 
points  which  are  connected  into  a  loop.  More  for- 
mally, a  set  of  contour  points  c, ,  Cj , . . . ,  c„  (for  (n  >  1 ) 
form  a  loop  iff  c,  is  a  neighbor  of  c,+,  for  K  i  <  n  and  c„ 
is  a  neighbor  of  c,.  We  use  L(l), . .  . ,  L{m)  to  label  the 
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FIG.  1.     Pixel  and  its  neighbors. 

different  contour  loops  of  a  pattern,  where  m  is  the 
number  of  contour  loops.  For  example,  the  digit  "3"  in 
Fig.  2  has  one  contour  loop  pattern  (m  =  1). 

Definition  4.  When  a  contour  point  u  is  pro- 
cessed, the  next  contour  point  to  be  processed,  u,  is 
called  a  successor  contour  point  of  u  and  u  is  called  a 
previous  contour  point  of  u.  In  Fig.  2,  if  the  pixel  "d"  is 
processed,  then  the  point  "c"  is  the  previous  contour 
point  of  "d"  and  "e"  is  the  successor  contour  point 
of  "d." 

Definition  5.  Let  p  be  the  processing  contour 
point.  Let  x  be  the  previous  contour  point  of  p,  and  z 
be  the  successor  contour  point  of  p.  Then  s  will  be 
called  a  successor  function  if  z  =  s(x,  p)  is  a  function 
from  X  according  to  clockwise  order  around  the  neigh- 
bors of  p  to  meet  the  first  1  pixel  z.  In  Fig.  2,  if  the 
current  processing  pixel  is  the  'f  at  the  top  right 
corner,  and  the  previous  contour  point  of  "f '  is  "e," 
then  z  =  s("f,"  "e")  is  "h." 

3.  THINNING  ALGORITHM 

Thinning  algorithms  proposed  by  various  re- 
searchers [1-11]  can  be  generally  grouped  into  three 
categories:  serial,  parallel,  and  maximum  methods.  In 
serial  thinning  algorithms,  the  value  of  a  pixel  at  the 
nth  iteration  depends  on  a  set  of  the  pixels  for  some  of 
which,  the  result  of  nth  iteration  is  already  known.  In 
contrast,  the  vadue  of  a  pixel  at  the  nth  iteration  of  a 
parallel  thinning  algorithm  depends  only  on  the  val- 
ues of  that  pixel  and  its  neighbors  at  the  (n  —  l)th 
iteration;  as  such,  all  the  pixels  of  the  digital  pattern 
can  be  thinned  simultaneously,  enabling  these  algo- 
rithms to  ofifer  faster  speeds  than  the  equivalent  serial 
thinning  algorithms.  The  third  category  of  algorithms 
focuses  on  maximization  of  particular  functions  dur- 
ing the  process  of  skeletonization. 

ThQ  thinning  method  for  digital  patterns  proposed 
in  [11]  provides  an  efficient  thinning  process  with  re- 
spect to  parallelism  and  connectivity.  However,  the 
algorithm  involves  a  number  of  time  consuming  steps 
which  can  be  improved  upon.  As  such,  a  new  but  func- 


tionally equivalent  algorithm  incorporating  these  im- 
provements IS  discussed  below. 

The  bitmap  is  stored  in  a  matrix  Q  and  the  follow- 
ing functions  are  uis'ed  by  the  algorithms. 

1.  initial:  a  function  that: 

(a)  computes  the  contour  loop  number  m; 

(b)  computes  the  first  contour  point  FIRST[fe], 
and  its  previous  point,  PREV[^],  for  each  contour 
loop  L[k],  (fe  =  1,  2 m);  and 

(c)  sets  the  initial  value  '1'  to  loop  decision  vari- 
able h[k],  where  h[k]  =  1  means  that  the  contour  loop 
points  need  to  be  thinned.  • 

2.  loop-end-test  (k):  a  function  that  tests  whether 
the  /eth  contour  loop  is  terminated. 

3.  contourip):  a  function  that  tests  whether  a  point 
is  lying  on  a  contour  or  not.  It  just  looks  for  a  white 
space  ("off"  pixel)  in  the  neighborhood  of  the  point. 

4.  successor  (x,  p):  a  function  that  computes  the  suc- 
cessor point  from  the  previous  point  x  according  to 
clockwise  order  around  the  neighbors  of  p  to  meet  the 
first  "on"  pixel. 

5.  deletion  (Q,  p):  a  function  that  deletes  a  point  p 
in  Q  (i.e.,  sets  a  l_pixel  to  0)  if  it  satisfies  the  follow- 
ing two  conditions: 

(a)  1  <  B(p)  <  7;  and 

(b)  (A(p)  =  1  or  dp)  =  1)  and  (p[2)  + 
p(4])*p[0]*p(61  =  0)  or  (A(p)  =  1  or  C{p)  =  1)  and 
(p[01+p[6])*p[2]*p[4]=0), 

where  B(p)  is  the  number  of  neighbors  of  p  which  are 
not  equal  to  zero.  A(p)  is  the  number  of  off'-to-on 
transitions  when  the  neighbors  are  taking  a  clockwise 
walk  around  p  (i.e.,  along  the  neighbors  of  pixel  p). 

1    p[A  -  1) +p[*] +p[fe+ 1] 

-I- p[fe -I-  4]  =  0 
C(p)  =  {         andp[k  -I-  3]  =  1  andp[k  -H  5]  =  1 

k  =  lOT  k  =  3 
0    otherwise 
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FIG.  2.     Digit  pattern  "3."  Note:  In  the  actual  data  only  two  types 
of  pixels  exist — 0  or  1. 


The  parallel   thinning  algorithm  by  Wang  and 
Zhang  in  [11]  performed  thinning  as  follows: 
Algorithm  WZ: 
initial;  g=  1; 
repeat 
<?  =  <?1;  if  (g==  1)  theng=  0:  elseg=  1; 
for  ;:  =  1  to  flido  if  73[;f]  =  1  then 
begin  p  =  FIRST[;f] ;  x  =  PREV[;c] ; 
h[k]  =  0; 
repeat 
z  =  successor  {x,  p) ;  x  =  p; 
case  goi 
0:  ifl<B(p)  <7  and  (A(p)  =  1  or 
c(p)  =  1) 
and  (  p[2]  + 
P[4])*p[0]* 
P[6]  =0 
then    begin    deletion    {Ql.    p)  ■ 
h[k]  =  1  end; 
1:  if  1  <B(p)  <7and  (i4(p)  =  1  or 
c(P)  =  1) 
and(  p(0]  + 
P[6]) 

*Pl2]*  p[4]  =0 
then    begin    deletion    (^1,    p) ; 
h[k]  =  1  end; 
end  case; 
P=  z; 
until  loop-end-test  {k) 
end 
until  h[l]  +  •  •  ■  +  h[m]  =  0. 
The  proposed  new  parallel  algorithm  operates  as  fol- 
lows: 

Algorithm  NWG: 
g=  1; 
repeat 
h  =  0: 

Q  =  Q1:  if  g==  1  then  g=  0;  else  g=  1; 
for  each  array  element  p  of  ^ 
begin  if  contour(  p)  then 
case  gof 
0:   if  1  <  S(p)  <  7  and  (>l(p)  =  1  or 

c{p)  =  1) 
and  (p[2]  -I- 
P[4])*p[0]* 
p[6]  =0 
then  begin  deletion  (^1,  p) ;  h[k] 
=  1;  A  =  1;  end; 
1:  if  1  <  5(p)  <  7  and  (>l(p)  =  i  or 
c{p)  =  1) 
and  {  p[0]  + 
P[Q])*p[2]* 
Pl4]  =0 
then  begin  deletion  (  ^1 ,  p)  ;  h[k] 
=  1;  A  =  1;  end; 


end  case; 
end  for; 
until  h  =  0; 

In  each  iteration,  the  new  algorithm  uses  only  a 
subset  of  the  operations  involved  in  the  earlier  algo- 
rithm. During  a  single  pass  over  the  full  array,  Algo- 
rithm NWG  uses  two  operations— contour(p)  and  de- 
letion (Ql,  p),  whereas  Algorithm  WZ  used  initial, 
loop-end-test(k),  successor(x,  p),  and  deletion  (Q,  p), 
FIRST[*],  PREV(/e)  and  contour(p)  as  a  part  of  ini- 
tial, FIRST[/e]  and  PREV[)ij].  Further,  the  function 
contour(p)  is  used  at  least  as  many  times  in  FIRST[/e] 
as  it  is  in  Algorithm  NWG;  at  least  one  scan  is  needed 
to  detect  the  starting  points  of  all  the  contour  loops  in 
the  array.  The  speed  of  the  new  algorithm  is  signifi- 
cantly higher  than  the  earlier  one.  Also  the  new  algo- 
rithm can  be  programmed  more  readily. 

JUNCTIONAL  EQUIVALENCE  PROOF 

This  section  provides  a  proof  that  the  new  algo- 
rithm is  operationally  equivalent  to  the  earlier  algo- 
rithm, that  identical  intermediate  outputs  occur  at 
the  end  of  each  iteration  for  both  cases,  and  that  the 
final  outputs  will  also  be  identical. 

Lemma  1.  If  the  data  array  at  the  beginning  of  ith 
pass'  is  identical  for  both  the  algorithms,  and  further  if 
Algorithm  WZ  marks  a  point  p  for  deletion  during  the 
pass  in  the  data  array,  then  Algorithm  NWG  also 
marks  the  same  point  p  for  deletion. 

Proof  For  Algorithm  WZ,  to  mark  point  p  for  de- 
letion, the  following  conditions  must  be  satisfied: 

•  point  p  must  be  on  one  of  the  m  contour  loops; 
and 

•  the  case  statement  must  have  been  satisfied. 
But  if  the  point  p  is  a  part  of  any  contour  loop,  then 
contour  (p)  must  be  satisfied.  If  contour  (p)  is  satisfied 
and  the  case  statement  is  satisfied,  then  Algorithm 
NWG  will  mark  the  point  p  for  deletion. 

Lemma  2.  //  the  data  array  at  the  beginning  of  ith 
pass  is  identical  for  both  the  algorithms,  and  further  if 
Algorithm  NWG  marks  a  point  p  for  deletion  during 
the  pass  in  the  data  array,  then  Algorithm  WZ  also 
marks  the  same  point  p  for  deletion. 

Proof  For  Algorithm  NWG,  to  mark  point  p  for 
deletion,  the  following  conditions  must  be  satisfied: 


'  Here  a  pass  means  the  number  of  times  Q  =  Ql  sUtement  is 
executed.  If  this  algorithm  is  modified  for  execution  on  a  parallel 
computer,  then  the  step  involving  Q  =  Ql  will  not  exist.  Then  the 
number  of  passes  over  the  array  is  the  number  of  times  Q  =  Ql  gets 
executed. 


If  a  point  p  is  marked  out  for  deletion  by  Algorithm 
NWG,  then  the  following  conditions  must  be  satis- 
fied: 

•  contour  (p)  must  be  true;  and 

•  the  case  statement  must  have  been  satisfied. 
But  if  contourip)  is  true,  then  p  must  belong  to  one  of 
the  m  contours  and  hence  must  be  one  of  the  points 
encountered  while  Algorithm  WZ  traverses  the  con- 
tour loops.  When  this  point  is  encountered  and  if  the 


case  statement  is  satisfied,  then  Algorithm  WZ  will 
mark  the  point  p  for  deletion. 

Lemma  3.  Algorithm  WZ  and  Algorithm  NWG  ex- 
ecute an  identical  number  of  passes  over  the  data  array. 

Proof.  The  proof  is  obvious  from  the  way  the  two 
algorithms  are  constructed.  During  a  pass.  Algorithm 
WZ  goes  over  all  the  contours  in  the  array  once  and  if 
there  is  a  deletion  during  the  traversal  of  any  of  the 
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FIG.  3.     Examples  of  digit  bitmaps  and  their  skeletonized  versions. 


cm 


contour  points,  then  there  is  another  iteration  over 
the  data  array.  Algorithm  NWG  goes  over  ail  the 
points  in  the  array  and  deletes  only  points  that  reside 
on  the  contour.  If  there  is  any  deletion  during  the 
pass,  then  it  goes  through  another  iteration.  Since  at 
the  end  of  any  intermediate  iteration,  the  same  out- 
put is  produced  by  both  of  them,  they  will  terminate 
after  an  identical  number  of  iterations. 

Theorem.  Algorithm  NWA  and  Algorithm  WZ 
are  operationally  equivalent,  that  is,  given  the  same 
input,  they  produce  the  same  output. 

Proof.     Follows  from  Lemmas  1,  2,  and  3  above. 

5.  RETHICKENING 


The  skeletonization  algorithm  above  was  devel- 
oped as  a  part  of  a  larger  ongoing  project  on  auto- 
mated handwritten  numerals.  The  numerals  input  to 
a  general  handwriting  recognition  system  could  have 
been  written  using  various  kinds  of  pens  like  felt  pens, 
ball  pens,  or  microtipped  pens.  Each  of  these  writing 
instruments  creates  characters  of  different  thickness. 
In  order  to  reduce  these  variations,  the  input  pattern 
is  scaled  down  to  a  single  pixel  thickness  and  then 
rethickened  to  a  uniform  thickness.  The  algorithm 
above  thins  down  the  numeral  pattern  to  a  thickness 
of  one  pixel.  This  "skeletal"  bitmap  of  the  numeral  is 
now  rethickened  to  a  standard  thickness,  allowing 
numerals  of  varying  thickness  to  be  rethickened  to  a 
uniform  thickness.  Even  within  the  bitmap  array  of  a 
numeral,  the  thickness  of  the  numeral  may  be  differ- 
ent in  different  parts.  Thinning  and  rethickening  can 
also  smoothen  these  variations  to  a  large  extent. 

The  algorithm  for  rethickening  looks  at  a  pre-spec- 
ified  neighborhood  of  each  l_pixel  and  fills  this 
neighborhood  with  I's. 

6.  RESULTS 


The  National  Institute  of  Standards  and  Technol- 
ogy (NIST)  Handprinted  Character  Database  was 
utilized  as  the  basis  for  providing  standardized  in- 
puts. The  raw  data  in  a  bitmap  form,  with  an  average 
size  of  about  50  X  350,  were  normalized  to  a  16  X  150 
array.  In  the  latter  array,  the  data  were  typically  4  to  6 
pixels  in  thickness.  Figure  3  shows  a  sample  set  of 
numerals  before  skeletonization  and  the  correspond- 
ing skeletonized  numerals  obtained  as  the  output  of 
the  proposed  algorithm.  Figure  4  shows  a  few  samples 
of  digits  which  were  skeletonized  and  then  rethick- 
ened. Note  that  the  digits  in  the  first  column,  which 
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FIG.  4.     Examples  of  numerals,  and  their  skeletonized  and  re- 
thickened versions. 


were  the  original  digits,  are  of  varying  thickness.  Cer- 
tain numerals,  like  '5,'  are  extremely  narrow,  whereas 
certain  others,  like  '1,'  are  of  bigger  thickness.  Even 
within  the  bitmap  of  some  numerals,  like  "7,"  there 
are  variations  in  thickness.  The  third  column  repre- 
sents the  rethickened  digits  which  are  distinguished 
by  the  uniformity  in  their  thickness  not  only  within  a 
numeral  bitmap  but  also  within  a  set  of  numeral  bit- 
maps. 


7.  CONCLUSION 
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Apart  from  presenting  the  motivation  for  thinning 
and  rethickening,  this  paper  has  discussed  algorithms 
for  performing  these  tasks  efficiently.  The  new  thin- 
ning algorithm  has  been  shown  to  be  faster,  but  func- 
tionally identical  to,  one  of  the  fastest  thinning  algo- 
rithms in  existence.  By  using  the  algorithms  pre- 
sented in  this  paper,  raw  inputs  with  underlying 
deficiencies  in  terms  of  unequal  thickness  can  be  nor- 
malized to  yield  higher  overall  speed  and  accuracy. 
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